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SUMMARY 

The  full  paper  will  describe  recent  theoretical  results,  backed  up  by 
digital  computer  simulation  studies,  that  relate  to  the  performance  of 
several  adaptive  control  algorithms  that  are  based  on  model  reference 
techniques.  Special  emphasis  was  placed  upon  the  transient  performance 
of  these  algorithms  and  the  implications  upon  the  bandwidth  of  the  closed 
loop  adaptive  system.  The  conclusions  are  as  follows: 

(1)  During  the  transient  phase  of  the  adaptation  procedure,  the 
control  signal  is  characterized  by  excessive  high  frequency 
content.  Novel  analytical  studies  based  upon  stability 
theory  can  be  used  to  predict  this  high  frequency  oscillatory 
behavior,  which  depends  both  upon  the  amplitude  and  frequency 
of  the  reference  input. 

(2)  During  the  transient  adaptation  phase  the  excessive  control  loop 
bandwidth  is  detrimental  to  system  performance,  because  it  can 
excite  unmodeled  high-frequency  dynamics  and  lead  to  instability. 

(3)  Similar  effects  can  occur  in  the  presence  of  stochastic  inputs 
(plant  noise  and  measurement  noise) . 

The  analytical  techniques  that  have  been  developed  are  constructive,  so 
that  modifications  to  the  existing  algorithms  are  suggested  to  overcome 
the  practical  shotcomings  of  the  existing  algorithms.  Full  details  will 
be  given  in  the  conference  paper,  , 
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EXTENDED  ABSTRACT 


Many  globally  asumptotically  stable  adaptive  control  algorithms  have 
been  developed  in  the  past  few  years  and,  more  recently,  have  been  unified 
tinder  the  same  underlying  principles  [1] . 

In  practice,  however,  as  a  rule  these  algorithms  exhibit  rather  poor 
behavior.  In  [2]  this  was  demonstrated  by  digital  simulations  of  such 
systems  for  cases  of  accurate  modeling,  modeling  errors  which  exclude  high 
frequency  dynamics  and  with  observation  noise  present  at  the  output. 

The  present  paper  contains  analytical  results  which  explain  and 
quantify  the  problems  observed  in  [2].  Additionally,  modifications  to 
the  algorithms  are  suggested  which  result  in  improved  behavior  for  the 
cases  analyzed. 

More  specifically,  although  certain  versions  of  the  self-tuning 
regulator  have  been  shown  to  work  on  systems  with  slow  dynamics,  such  as 
ocean  tankers  and  some  industrial  processes,  in  general  serious  problems 
can  arise  when  most  of  the  existing  adaptive  algorithms  are  applied  to 


systems  characterized  by  fast  time-constants,  oscillatory  or  unstable 
dynamics  and/or  unmodeled  high  frequency  dynamics,  and/or  significant 
stochastic  disturbances  and  noisy  sensor  measurements.  Moreover,  all 
available  algorithms  can  exhibit  transient  undesirable  behavior  which  makes 


them  dangerous  to  use  in  practical  applications,  e.g.  control  of  aircraft 
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and/or 

In  [2]  it  was  observed  that,  even  when  the  system  was  properly  modeled,al 
the  plant  was  subjected  by  the  control  input  to  high  frequencies  of 
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considerable  magnitude,  during  the  early  stages  of  adaptation.  Clearly, 
such  high-frequency  inputs  are  undesirable,  as  they  will  inevitably 
excite  unmodeled  dynamics  that  can  in  turn  cause  instability. 

Secondly,  it  was  also  shown  [2]  that,  in  the  presence  of  an  unmodeled 
high-frequency  pole,  the  adaptive  system  exhibited  wildly  oscillatory, 
and  even  unstable,  closed  loop  behavior. 

Lastly,  the  presence  of  even  a  small  amount  of  observation  noise  pre¬ 
vented  the  closed  loop  system  from  converging  to  the  desired  model  by 
causing  it  to  slowly  drift  away  to  an  increasingly  higher  bandwidth  system. 
As  a  consequence,  high  frequency  unmodeled  dynamics  will  eventually  be 
excited  even  at  an  advanced  stage  of  the  adaptation  process.  This  increase 
in  the  bandwidth  of  the  closed- loop  system  was  also  observed  by  Narendra 
and  Peterson  14]  in  terms  of  a  scalar  example. 

In  order  to  obtain  practical  insights  as  well  as  analytical  results, 
a  simple  scalar  system  was  first  studied  in  a  systematic  way.  The  equations 
that  describe  it  are  given  below: 


Plant  Dynamics: 

y(t) 

=  -ay(t)  +  0u(t) 

(l.a) 

Model  Dynamics: 

ym(t) 

in 

=  -ay  (t)  +  br(t) 
m 

(l.b) 

where  the  plant  control  is  given  by  u(t)  =  O^tjytt)  +  02(t)r(t),  with 
r(t)  being  the  reference  input  and  ©1(t),  02(t)  adjustable  (control) 
parameters  used  in  the  control  signal  synthesis.  The  first  algorithm  for 
the  control  parameter  adaptation  studied  was  that  proposed  by  Narendra  and 
Valavani  [5] »  its  scalar  version  consists  of  the  following  system  of 
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nonlinear  differential  equations  for  the  output  error,  e(t),  and  para¬ 
meter  errors  $^(t),  <J>2(t),  as  well  as  the  plant  state,  y(t). 


y(t)  =  ■ 

-ay(t)  +  8u(t) 

(2. a) 

e(t)  =  • 

-ae(t)  +  bi^ftJyCt)  +  b<J>2(t)r(t) 

<2.b) 

♦Jt)  « 

“Ylly(t)e(t)  ”  Y12e(t)r(t) 

(2.c) 

i2(t)  " 

-Y21y(t)e(t)  -  Y22e(t)r(t) 

(2.d) 

where  e(t)  =  ym<t)  -  y(t)  and  <J>^(t),  4>2(t)  are  the  parameter  errors; 

Yij#  i,j=l,2,  are  constants  and  such  that  Y^>0»  yny22>yi2y2l’ 

A  stability-based  time-varying  analysis  of  the  properties  of  the 
nonlinear  time-varying  system  described  by  eqns.  (2)  resulted  in  the 
development  of  a  new  analytical  method  that  explains  and  even  predicts 
the  behavior  of  the  adaptive  system  observed  in  the  simulations.  The 
analytical  results  thus  obtained  are  valid  in  the  vector  case  as  well; 
they  also  provide  further  insights  into  the  mechanism  of  adaptation.  Due 
to  the  inherent  nonlinearity  of  the  closed- loop,  it  was  found  that  the 
behavior  of  the  system  is  sensitive  to  both  the  magnitude  of  the  reference 
input  and  the  input  frequencies.  A  large  reference  input  magnitude  can 
create  arbitrarily  high  frequency  content  in  the  adjustable  (control)  para¬ 
meters,  (t)  and  4>2  (t) ,  and,  therefore,  also  in  the  control  signal, 
u(t) . 

Moreover,  this  analysis  demonstrates  that  the  parameter  errors,  ^  (t) 


and  $2 (t) ,  do  not  necessarily  converge  to  zero  but,  rather,  to  a  linear 
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subspace  in  the  parameter  space  where  the  output  error  is  identically 
zero.  This  subspace  evolves  in  time,  and  its  evolution  is  dependent 
on  the  time-varying  characteristics  of  the  reference  input  and  the  plant 
output.  If  the  reference  input  is  such  that  the  subspace  remains  fixed, 
no  changes  in  the  parameters  occur.  If,  however,  the  subspace  varies 
with  time,  the  parameter  errors  will  approach  it  from  a  direction  orthogonal 
to  it.  It  is  precisely  here  that  the  so  called  "richness"  of  the  adaptive 
signals  could  play  an  important  role,  insofar  as  parameter  error  convergence 
is  concerned.  It  is  becoming  increasingly  apparent,  however,  that  the 
closed  loop,  given  the  present  algorithms,  cannot  satisfy  the  "richness" 
conditions  required  for  asymptotic  convergence.  This  has  obvious  impli¬ 
cations  for  certain  adaptive  [6,7]  schemes  whose  overall  global  stability 
hinges  heavily  on  exact  parameter  convergence.  On  the  other  hand, 
stability  results  have  been  obtained  recently  for  the  above  mentioned  class 
of  algorithms,  irrespective  of  "sufficient  excitation"  and  parameter  con¬ 
vergence  [8] ;  but  they  are  valid  only  locally. 

When  the  algorithm  described  in  [5]  was  studied  with  an  unmodeled 
high  frequency  pole,  the  same  analytical  results  successfully  explained 
the  exhibited  oscillatory,  and  eventually  unstable,  behavior  and,  moreover, 
demonstrated  the  same  dependence  of  such  behavior  on  the  reference  input. 

In  the  case  of  observation  noise,  n(t),  our  analysis  shows  that  a  term 
2 

containing  n  (t)  will  in  effect  keep  driving  the  error  system  and,  there¬ 
fore,  the  parameter  error  can  increase  within  the  zero  output  subspace 
discussed  above.  But  if  the  variance  of  the  measurement  noise  is  known, 
this  term  can  be  subtracted  out.  Unfortunately,  the  problem  still  remains 
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of  white  noise  being  input  into  a  marginally  stable  system  in  the  same 
subspace.  However,  since  the  noise  also  drives  (affects)  the  time- 
evolution  of  the  subspace,  it  may  very  well  be  the  case  that  the  decaying 
effect  of  the  time  evolution  of  the  subspace  on  the  parameter  errors  is 
enough  to  keep  their  variance  bounded. 

The  analytical  framework  mentioned  in  the  foregoing  was  employed  to 
study  different  adaptive  algorithms  and  consistency  of  the  results  was 
shown.  Specifically,  our  study  so  far  has  concentrated  on  the  algorithms 
obtained  using  a  stability  point  of  view  for  their  derivation,  the  most 
important  representatives  of  which  are  Monopoli's  [9],  Narendra, 

Valavani  and  Lin's  [5,10],  Feuer  and  Morse's  [11],  Landau  and  co-workers' 
[12],  both  for  discrete  as  well  as  continuous-time  systems.  In  the  analysis, 
the  above  algorithms  all  shared  the  same  characteristics,  although  seme 
exhibited  marginally  better  behavior  in  some  numerical  cases.  For  example, 
the  algorithm  described  in  [10]  remained  stable  in  the  presence  of  one 
unmodeled  pole,  with  increasing  reference  input  amplitude,  although  the 
control  signal  was  heavily  oscillatory.  However,  the  presence  of  two 
unmodeled  high-frequency  poles  resulted  in  its  instability.  Conversely, 
the  observation  noise  enters  here  in  .a  much  more  complicated  way  than  in  the 
rest  of  the  algorithms  examined. 

A  class  of  adaptive  algorithms  which  are  currently  being  investigated 

0 

in  the  framework  established  here  is  that  containing  Astrom  and  Wittenmark ' s 
basic  self-tuning  regulator  scheme  [13]  and  those  that  followed  it  along  the 
same  lines,  i.e.  some  schemes  contained  in  [14],  and  the  algorithms  obtained 


by  Goodwin,  Ramadge  and  Caines  [15].  These  are  basically  dead-beat 
algorithms  designed  for  discrete- time  systems.  Although  at  first  glance 
they  seem  to  have  some  advantage  over  the  others  with  respect  to  the  high 
frequency  content  of  the  control  input,  we  anticipate  a  much  worse  res¬ 
ponse  in  the  presence  of  unmodeled  dynamics.  Work  is  currently  in  progress 
to  verify  this  preliminary  conjecture. 

Finally,  based  on  our  theoretical  results,  we  are  developing  modi¬ 
fications  to  the  existing  schemes  that  avoid  the  undesirable  behavior 
described  so  far.  The  full  paper  will  describe  the  results  obtained. 

A  lot  of  future  research  is  required  along  these  lines,  before 
adaptive  algorithms  can  have  practical  impact,  apart  from  the  purely 
theoretical  appeal  they  have  enjoyed  so  far. 
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